"The highlighted tokens are primarily Thai morphemes, syllables, or short words that serve as key semantic or grammatical units within sentences. Many are high-frequency function words, affixes, or roots (such as those denoting comparison, agency, or time), and often appear at the start or end of compound words or phrases. These tokens are crucial for sentence structure, meaning, and cohesion in Thai text."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.69 | 1.0 | 0.38 | 0.551 | 0.38 | 1.0 | 0.0 | 0.62 |
fuzz | 0.7 | 1.0 | 0.4 | 0.571 | 0.4 | 1.0 | 0.0 | 0.6 |